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[57] 



ABSTRACT 



The effective (or logical) size of the encoder buffer in a video 
transmission system is varied with the transmission bit-rate. 
Also, a minimum fill level is maintained in the encoder 
buffer whenever the transmission rate is too high to assure 
otherwise that the decoder buffer will not overflow or 
underflow. The encoding rate is varied so as to maintain a fill 
level in the encoder buffer within limits. In the preferred 
embodiment, the logical encoder buffer has a size which is 
maintained at RATO-m^-M, where R is the average trans- 
mission bit-rate, which may vary, AT is the fixed delay 
between the encoding and decoding processes for a trans- 
mitted video signal, R(l-m m ) is the minimum instantaneous 
transmission rate that the communication system achieves at 
average rate R, and M is the maximum total buffer storage 
in the communication system. When the decoder buffer has 
a size less than RATU+m^, where RCl+mJ is the maximum 
instantaneous transmission rate at average rate R, the 
encoder buffer fill level is maintained above a minimum 
level that is equal to the amount by which the decoder buffer 
is less than RATO+nij). 



25 Claims, 4 Drawing Sheets 
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ENCODER BUFFER HAVING AN 
EFFECTIVE SIZE WHICH VARIES 
AUTOMATICALLY WITH THE CHANNEL 
BIT-RATE 

. BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates generally to transmission of com- 
pressed digital information having a constant time delay 
constraint over a transmission system having an effective 
transmission bit-rate which may vary, and more particularly 
to management of buffer storage and control of variable 
bit-rates in such systems. 

2. Description of the Related Art 

Currently there is much interest in creating systems which 
can efficiently deliver digital video on electrical or optical 
transmission lines into homes and businesses. Delivery of 
video movies to customers on demand is one application. 
Another is interactive home television. The so-called digital 
information superhighway concept includes the notion that 
video signals will be efficiently delivered just as telephone 
signals are today. 

To do this, video data must be compressed (usually called 
encoded) before transmission to a destination and then 
decompressed (usually called decoded) at the destination for 
display. FIG. 1 shows a typical prior art system. A digital 
video input signal 10 is compressed by encoder 12, trans- 
mitted to a destination site by a communication network 14, 
and decompressed by a decoder 16 to produce an output 
digital video signal 18. 

One requirement that real time transmission of video 
information imposes is that the encoded information for 
each successive video frame must be available for decoding 
and display at the destination when needed. If the encoded 
information for a video frame is not available at the decoder 
when it is needed, a video frame (or part of a frame) cannot 
be produced for display and video quality will be degraded. 
Once display of a video sequence is started at the receiver, 
a time delay is established between the compression process 
at the encoder and the decompression process at the decoder. 
This time delay must remain constant if there are to be no 
freeze frames or skipped frames. Herein, this will be called 
the constant time delay constraint. 

A constant time delay is made possible by anticipating 
variation in bit rate flow and accommodating it with buff- 
ering. The buffers must be partly filled so they can accept or 
deliver bits as required to accommodate anticipated bit rate 
flow variations. Appropriate time delay is introduced so that 
the buffers become suitably filled partially as desired before 
bits are released to the decoder for display. 

One source of bit rate flow variation is in the encoder 
itself. Efficient compression (or encoding) algorithms 
(including the ones used in the widely accepted MPEG-1 
and MFEG-2 standards created by the Moving Pictures 
Experts Group) do not compress (or encode) digital infor- 
mation at a constant compression ratio. In systems of this 
r type, not every pixel, block, macroblock or frame of video 
is compressed to the same number of bits. Thus the number 
of bits produced by an encoder of this kind in a unit of time 
r varies with time. The compression ratio (i.e., ratio of input 
■ bits to output bits) resulting from use of such algorithms 
/ typically varies with the content of the digital inforrnation 
/_ being compre^e&jkcoders of tMsjype which produce an 
output bit flow that is not uniform are said to do "variable- 
rate encoding". Any real time video transmission capability 
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that meets the MPEG standard must accommodate this 
variation in the rate at which bits are generated by the MPEG 
compression (or encoding) algorithms. Typically this is done 
by providing buffer storage at the encoder (i.e., buffer 20 in 
FIG. 1) and at the decoder (i.e., buffer 22 in FIG. 1). In such 
a system, bits may leave the encoder buffer at a constant rate 
(even in the presence of such variable-rate encoding), so 
encoders of this kind are called constant output-rate encod- 
ers. 

A second source of bit rate flow variation is the commu- 
nication system. In reality, even for constant output-rate 
encoders, the communication system is usually multiplexed 
in some fashion, so groups of bits (rather than individual 
bits) actually leave the encoder buffer at a uniform rate. This 
does not necessarily mean, however, that groups of bits 
entering the communication system at a uniform rate also 
will be delivered by the communication system to a desti- 
nation at a uniform rate. Whenever the communication 
system employs packetizing or there is any remultiplexing 
or switching of digital streams in the communication sys- 
tem, data groups experience variable delays in transmission 
time and data groups arrive at the decoder buffer in a bursty 
fashion. 

A typical transmission system is shown in FIG. 1. 
Encoder buffer 20 becomes the source of data stream S,. A 
multiplexer 24 multiplexes a plurality of source data streams 
S^Sg according to a packet scheduling algorithm to gener- 
ate one multiplexed bit-stream Dj. This bit-stream is then 
transmitted over the transmission facility 14, which typically 
includes a number of remultiplexing or packet switching 
nodes 26, 28 and a demultiplexer 30 serving decoder 16. 
Bit-stream D t does not remain in the same multiplexed 
format all the way to demultiplexer 30. At remultiplexing or 
packet switching stage 26, for example, one or more addi- 
tional source data streams S 4 might be added, and one or 
more additional bit-streams D 2 might be added as well. Also, 
the output from this stage might be divided into two or more 
output bit-streams D 3 , D 4) and one or more demultiplexed 
individual data streams (such as S 2 as shown) might be 
output as well. It is assumed that the S, data stream is 
contained in multiplexed output bit-stream D 3 , which enters 
another remultiplexing or packet switching node 28. Addi- 
tional bit-streams D 3 , D 6 might be added at this stage and 
bit-streams D 7 -D 9 might depart Bit-stream D 9 is assumed 
to contain data stream S t and enters demultiplexer 30, which 
reproduces data stream S x . 

It is important to note that while the output data stream S, 
contains the same packets of data that entered the commu- 
nication network and in the same order, the time spacing of 
the packets generally has been altered because the relative 
locations of individual packets are altered when D, is 
converted into D 3 and D 3 is converted into D 9 . The specific 
kind of transmission network is not important. However, it 
is important to understand that the kinds of transmission 
facilities described will necessarily include some buffer 
storage to accommodate remultiplexing or packet switching. 
Data packets cannot become displaced relative to each other 
unless there is some buffer storage to hold the data packets 
while relative displacement occurs. In FIG. 2 this buffering 
is generally represented as buffers 32. This network buffer 
storage is not taken into account in the conventional model 
for encoding systems. 

Additional complexity arises in satisfying the constant 
time delay constraint when the transmission system itself 
contains buffer storage in addition to the buffer storage at the 
encoder and at the decoder. The encoder and decoder buffers 
cannot be permitted to overflow (since this would result in 
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loss of data and produce a skip frame error) and the decoder 
buffer (at least) cannot be permitted to underflow (i.e., not 
have stored bits when stored bits are needed for decompres- 
sion) because this will produce a freeze frame error. 

It becomes even more complex to guarantee the constant 5 
time delay constraint if the average bit-rate at which an 
encoder operates can vary over time. Such encoders are 
called "variable output-rate" encoders. Encoders of this type 
are used, for example, in order to support joint bit-rate 
control or statistical multiplexing. These systems are desir- 1° 
able because it is generally better to allow the transmission ■ 
bandwidth allotted to existing active communication links or 
channels in a network to be degraded (i.e., continue at a 
reduced bandwidth) when necessary rather than have some 
of them terminated Also, much more sophisticated network 15 
management can be implemented if the bandwidth (i.e., 
bit-rate allotted to each link or channel) can be increased and 
decreased. 

Variable output-rate encoding cannot be accommodated 
• merely by providing additional buffer storage, at least not 20 
buffer storage of a reasonable size. A change in the average 
bit-rate at which the encoder is operating requires a corre- 
sponding change in the transmission channel-rate that the 
communication system allots to this encoder. However, 
synchronization of the two bit-rate changes is not required if 
there is adequate buffering to cover the asynchrony. 

MPEG standards were not designed to accommodate 
variable output-rate encoding. Furthermore, the MPEG stan- 
dards have specified the decoder in great detail, including 3Q 
the size of the decoder buffer. This was done because it is 
anticipated that there will be very many decoders and very 
few encoders in a typical system. In an on-demand video 
system, for example, there will be a decoder in each cus- 
tomer's home or business and only one encoder at the 35 
supplier of the on-demand video service. Buffer storage is 
too costly to place any more of it than necessary at each 
decoder. Therefore, the MPEG Committee specified the size 
of the decoder buffer in the MPEG-1 and MPEG-2 standards 
and these standards have been widely accepted. MPEG-2, ^ 
for example, specifies that the decoder buffer will be 1.75 
MB and allows transmission rates of up to IS MB. This 
buffer size equals about 1.2 second of storage at a 1.5 MB 
transmission rate and only about 0.12 seconds of storage at 
a 15 MB transmission rate. 45 

While the MPEG Committee specified the decoder in 
great detail (and assumed a constant bit-rate system), the 
encoder was left substantially unspecified (except of course 
that it must provide data compressed in a specified manner). 
If variable bit-rate operation is desired in a video transmis- 50 
sion system which uses decoders that meet the MPEG-1 or 
MPEG-2 standard, the encoder must be designed somehow 
to accommodate the bit-rate variation without involvement 
from the decoder and without changing the fixed decode 
buffer size specified by the MPEG standards. 55 

SUMMARY OF THE INVENTION 

It is an object of this invention to provide a system which 
i will compress or encode video information for transmission ^ 
on a communication network having a transmission bit-rate 
'allocated to such compressed video information which may 
/jvary and a buffer at the destination decompression or decod- 
ing receiver of fixed size. 

ITis also an object to provide such a system without 65 
involving the decoder whenever the bit-rate of the channel 
being used to transmit the compressed video changes. 



Another object is to provide an encoder which meets the 
MPEG standards and can be used on a transmission network 
having a variable average transmission bit-rate. 

Still another object is to provide a system for delivering 
compressed video information over a transmission network 
having a variable transmission bit-rate. 

These and further objects and features have been achieved 
by the present invention by making the effective (or logical) 
size of the encoder buffer vary with the transmission bit-rate 
R and by mamtaining a minimum fill level in the encoder 
-buffer whenever me transmission rate R is too high to assure 
otherwise that the decoder buffer will not overflow or^ 
underflow. The encoding rate is varied so as to maintain a fill j 
level in the encoder buffer within limits. f 
v In ' the preferred embodiment, the logical encoder buffer 
has a size which is maintained at RAT(l-m x )-M, where: R 
is the average transmission bit-rate, which may be varied; 
AT is the fixed delay between the encoding and decoding 
processes for a transmitted signal; RO+mj) is the minimum 
instantaneous transmission rate that the communication sys- 
tem achieves at average rate R; and M is the maximum total 
buffer storage in the communication system. When the 
decoder buffer has a size less than RATO+mJ, the encoder 
buffer fill level is maintained above a minimum level that is 
equal to the amount by which the decoder buffer is less than 
RATU+mJ. 

In order to achieve this, the encoder includes a logical 
encoder buffer size controller that receives prospective 
changes in the transmission rate R from the applicable 
channel-rate controller in the communication system and 
also knows the values of certain system parameters, such as 
the size of the decoder buffer, the amount of buffer storage 
in the communication system, if any, and the size of any 
significant instantaneous variation in transmission rate. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a conventional system for 
transmitting encoded video in real time. 

FIG. 2 is another block diagram of a conventional system 
for transmitting encoded video in real time with the encoder 
shown in more detail. 

FIG. 3 is a block diagram of a system for encoding and 
transmitting video in real time in accordance with this 
inventioa 

FIG. 4 is flow diagram of the encoder buffer size con- 
troller in the FIG. 3 embodiment. 

DETAILED DESCRIPTION 

While this invention may be used to transmit any kind of 
digital information over a transmission system in which the 
average bit-rate of transmission may vary and there is a 
constant time delay constraint between encoding and decod- 
ing, it is particularly useful in transmitting video data (and 
accompanying audio data) in compressed form over such a 
variable bit-rate transmission system. Accordingly, the 
invention will be described in the context of a video appli- 
cation of this invention, but it should be understood that the 
invention being described is not limited to transmission of 
video and audio data, but may be used as well to transmit a 
wide variety of digital information. 

Traditionally, real time video encoding systems have been 
modelled as constant output bit-rate sources, where any 
variation in the actual instantaneous encoding bit-rate (i.e., 
variable-rate encoding) is handled by a buffer, both at the 
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encoder and at the decoder. In such a system, bits leave the 
encoder buffer and enter the decoder buffer at a constant rate. 
The transmission system connecting the encoder buffer and 
decoder buffer has been modelled generally as a constant 
bandwidth channel (i.e., operating at a constant bit-rate). 5 
Buffering within the transmission system has been largely 
ignored. This is the model that was used to create the MPEG 
standards. 

While MPEG does not specify how the encoder will keep 
the encoder buffer from overflowing or underflowing, the l0 
usual way to assure this is to provide some kind of control 
loop at the encoder, which senses an increasing fullness of 
the encoder buffer and slows down the rate at which bits are 
being placed in the encoder buffer to prevent overflow of the 
encoder buffer. If the control loop senses that the encoder 
buffer is getting empty, it increases the rate at which bits are 
being placed in the encoder buffer to prevent underflow (i.e., 
depletion) of the encoder buffer. 
. Since the frame rate is constant for video signals and the 
compression ratio is not under direct control, the usual way 2(J 
> to vary the rate at which bits are being placed in the encoder 
L buffer'is to vary the number of bits representing each frame_ 
by representing each pixel with more of less bits as required. J 
The range of different pixel amplitude levels corresponding 
to a single digital value is called the quantization size and it ^ 
is detennined dynamically by a quantization size controller./" 
A quantizer and quantization size controller are part of a/ 
typical vi deo en coderrThey allow control of the quantization 
siztTof the video signal that is being compressed. For 
! example, normal video might represent the amplitude of 3Q 
i each pixel as one of 256 levels (represented with 8 bits). At 
I a low quantization size, each pixel is still represented by 
! many different amplitude levels (theoretically as many as the 
.. input quantization of 256 levels). At a high quantization size, 
j however, the number of possible amplitude levels is 35 

reduced, so the amplitude of each pixel can be represented 
f with less bits than at a low quantization size. The quantizer 
j essentially maps the 256 possible amplitude levels for the 
/ input signal to a lesser number of possible amplitude levels 
I for the signal that is compressed. Hie MPEG-1 standard ^ 
allows for up to 31 possible quantization sizes and the 
MPEG-2 standard allows for up to 100 possible quantization 
sizes. 

FIG. 2 illustrates functionally how quantization is used to 
keep the encoder buffer from underflowing or overflowing. 45 
The state of the encoder buffer 20 is determined by a buffer 
fullness detector 34. This determination may be done in 
many ways and in general may be computed or sensed. In 
FIG. 2, the buffer fullness detector determines buffer full- 
ness by counting the number of bits going into the encoder 50 
buffer via line 35 and counting the number of bits coming 
out of the encoder buffer via line 36. The total number of bits 
going in less the total number of bits coming out is the total 
number of bits in the encoder buffer. The total number of bits 
in the encoder buffer is then divided by the size of the 55 
encoder buffer (i.e., the size being the total number of bits 
which can be placed in the encoder buffer without overflow). 

The buffer fullness value is sent to an enoding rale 
controller (or quantizer controller) 38, which uses a prede- 
termined algorithm to determine which one of many differ- 60 
ent quantization levels will be used by quantizer 40 for each 
possible fullness state of the buffer. In general, as the buffer 
gets fuller, the algorithm will yield a higher quantization 
level for use by quantizer 40, which means less bits will be 
used to represent each input value. For example, as shown 65 
in FIG. 2, the amplitude of a pixel of video may be 
represented at the input to the encoder as one of 256 levels 
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(i.e., 8 bits of amplitude information). The finest quantiza- 
tion (normally called the lowest quantization) might pre- 
serve all of this information and therefore also produce 256 
possible levels of amplitude. We might view the output of 
quantizer 40 as having 2567Q levels of amplitude. As Q gets 
larger, the number of possible levels of amplitude gets 
smaller and can be represented with fewer and fewer bits. 
The encoder buffer is kept from overflowing by increasing 
Q as the fullness of the buffer goes up. In general, this is not 
a linear function. Also, the encoder buffer is kept from 
underflowing by decreasing Q as the fullness of the buffer 
goes down. Again, this is not generally a linear function and 
the two functions may be different (i.e., the quantization 
level for a particular fullness value may depend upon 
whether the fullness values are increasing or decreasing. 

Data 42 which has been quantized is then received by a 
digital compressor 44 and the compressed result 46 is 
deposited into the encoder buffer 20. 

In the MPEG model, the output of the encoder buffer is 
conceptually connected to the input of the decoder buffer. 
Therefore, it doesn't take into account remultiplexing and 
packet switching that might exist between the encoder and 
the decoder. It also assumes constant bit-rate operation. So 
the MPEG model is not suitable when the channel bit-rate 
can vary. We will now develop a new model by analyzing 
what constraints need to be satisfied to prevent decoder 
buffer underflow and overflow while meeting the constant 
time delay constraint in the case of variable-rate coding, 
packetized transmission, remultiplexing and packet switch- 
ing. An embodiment of this invention will then be described 
which meets these constraints. 
Theory of the Invention 

Let a unit of time be one packet slot time, T. In this time, 
T, multiplexer 14 transmits one packet of data from one of 
the sources that it is multiplexing. Packets originating from 
a particular source are transmitted in the packet slots that the 
scheduling algorithm for the multiplexer allots to that par- 
ticular source. Typically, the allocation of transmission slots 
to the various sources is done by allocating a fixed data rate 
to each source. Every individual source then controls the 
status of its output buffer (encoder buffer for sources that are 
encoders), with the assumption that it has this defined 
amount of data rate at its disposal. Another way of doing the 
same thing would be to perform data rate control consider- 
ing all sources. In this case, an encoder can borrow data 
bandwidth from another source that does not require it at that 
instant. In cither case, we assume that it is the responsibility 
of an encoder to ensure that its encoder buffer neither 
underflows nor overflows. 

Assume that in the i'th unit of time, the encoder puts b, 
bits into the encoder buffer. In that period of time, the 
multiplexer 14 removes p8 w bits, where 5 W = 1 if the sched- 
uler has allotted that slot to this particular encoder and is 0 
if not. p is the payload of the packet or the number of bits 
from the encoder buffer that go into one packet 

Let the delay between when the encoder inserts bits into 
the encoder buffer and when the decoder removes them from 
the decoder buffer, be A units of time. At the demultiplexer, 
the decoder buffer receives p5 d , bits in the i'th unit of time. 
Again, & di =1 when the decoder buffer receives a packet 
from the demultiplexer and is 0 when it doesn't. In the 
absence of remultiplexing, 0^=0^. The inherent assumption 
here is that the encoder system clock and the decoder system 
clock are in lock, since we are equating, time instances 
measured by two different clocks. 
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The number of bits in the encoder buffer after time nT is 



(EB)«= £ bi-p £ 8d. 



(EQ1) 



The decoder decodes the bits produced by the encoder A 5 
units of time after the encoder produces them. Thus, the 
decoder decodes b, bits in the i+A'th slot The status of the 
decoder buffer at time (n+A)T is therefore 



n4A #) 



CEQ2) 
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Substituting equation (EQ1) in equation (EQ2), we have 



n n+A , 

{DB)^ = -(EB)*-P £fa+P £ fa= 
(=1 t=l 



(EQ3) 



15 



(n+A /1 \ 



The encoder ensures that the encoder buffer neither under- 
flows nor overflows. If the size of the encoder buffer is B e , 
then 



20 



CEQ4). 



From equations (EQ3) and (EQ4), we have for the 25 
decoder buffer, 

/n+A n \ /nM t n \ (EQ5) 

pi .£ fe-^ fa I 5fr^ ^fa-^T fa j. 

If the decoder buffer of size B d is to neither underflow nor 30 
overflow, the following equation must be satisfied, 



(n+A n \ 

Z fa % £fal 



(EQ6) 



Variable-Rate Operation 35 

We will now examine the two special cases in which we 
are interested. In a constant non-bursty bit-rate mode 
(although constant non-bursty may sound redundant, we use 
this here to refer to a mode of operation where bits leave the 
encoder buffer at a constant rate), the number of bits that 40 
leave the encoder buffer in time t is Rt, where R is the output 
rate. However, in a discrete packetized case, the multiplexer 
will not be able to satisfy this for all encoders at all times and 
the instantaneous rate will vary. Let us bound the variation 
in the instantaneous channel rate by stating that the mini- 45 
mum instantaneous rate is Rd-mj) and the maximum 
instantaneous rate is RU+mJ. When m l =m 2 =m, this con- 
straint implies that the instantaneous rate can vary by at most 
100 ra%. What is left to be determined is how we define the 
instantaneous rate. Note that equation (EQ6) bounds the 50 
number of bits transmitted from a source in A units of time, 
where AT is the delay. Therefore, we define the instanta- 
neous rate to be equal to the number of bits that leave the 
encoder buffer in a period of time equal to the delay, divided 
by the delay. It is thus the average rate over that period of 55 
time. Thus the constraint on the multiplexer will essentially 
be: In A units of time, the number of bits allocated to the 
source must be at least RO-mJAT and must be no larger 
than RU+mJAT. 

Multiplexed Bit-Stream with Remultiplexing 60 

Now, we consider the case where we have multiple 
sources being multiplexed to create one bit-stream. This 
bit-stream however, undergoes stages of remultiplexing in 
between the encoder and the decoder. Let the total number 
of multiplexers/demultiplexers/remultiplexers in the link be 65 
J. Of these, the first in the link is a multiplexer at the encode 
site, the J'th is a demultiplexer at the decode site, and the 
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remaining J-2 are re-multiplexers. If J=2, then there are no 
re-multiplexers. Again, assume that the source of interest is 
operating at a constant output-rate R. Let B^n) denote the 
number of bits output by the j'th re-mux in time n, that 
belong to the source that we are considering. Let hJn) be 
the number of bits from the same source input to the j'th 
re-mux in time n. Thus equation (EQ6) implies that 



B g S .£ (fl <l Kn + A)-fi i KB + A))+5 fl i(n + A)-fin(n)SBrf. 
j=2 



(EQ7) 



This translates to: B, is less than or equal to the number 
of bits removed from the encoder buffer in the last A units 
of time (or in AT seconds) minus the total number of bits 
buffered in all of the re-muxes, which in turn is less than or 
equal to B d . 

Using the same nomenclature as before, and if the maxi- 
mum number of bits that can be buffered in the system 
(including all muxes) is M, we have 



B,+M=R6JX.\-m t ) 
So the size of the encoder buffer is 
*,=*Ani-miHtf 



(EQ8) 



CEQ9) 



The size of the decoder buffer, if the minimum number of 
bits buffered in all the multiplexers is 0, is given by 



(EQ10), 



Another way of writing equations (EQ9) and (EQ10) is as 
follows: 



(EQll) 



Thus B c is the amount of decoder buffer required as a 
result of variable rate encoding, RATfmi+mj) is the amount 
of buffer required as a result of the variation in the channel 
rate, and M is required as a result of the buffering in the 
remultiplexers. Note that if the minimum number of bits 
buffered in the remultiplexers is greater than zero and equal 
to M min , then the extra buffering required at the decoder is 
not equal to M, but is M-M mitl . In other words, the extra 
buffering required at the decoder is not in order to compen- 
sate for the maximum buffering in the remultiplexers, but is 
to accommodate the variation in the amount of buffering in 
the remultiplexers. 

In this case, the delay is ByORXl+mJ). Again, the delay 
decreases monotonically with m-j, while the size of the 
decoder buffer increases monotonically with M, m 1( and m^. 
In this case too as seen earlier, the size of the decoder buffer 
is larger than in the constant bit-rate case. 
Variable Output-Rate Source 

Now let us consider an encoder whose output-rate varies 
with time in a piece wise constant fashion. This is an accurate 
model for most variable output-rate encoders. Let the rate 
over the time period that we are considering be R and let 
R,^ be the new output-rate for the next period of time. As 
we said before, in equations (EQ9) and (EQ10), R(l-m 1 ) is 
the minimum instantaneous channel rate and RO+mJ is the 
maximum instantaneous channel rate allocated to this 
source, where the instantaneous rate is calculated over a 
period of time equal to the delay. Thus, the instantaneous 
rate of the channel can vary between R(l-mj) and RO+mJ. 

One approach might be to broaden the range of RCI-it^) 
to RO+mJ to cover not only instantaneous rate changes, but 
also the piecewise constant changes as well. Equation (EQ7) 
reduces to the following two equations 



^S/ZATU-miMf 



CEQ12). 
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Thus, if the channel-rate is allowed to vary between 
R(l-mj) and RU+mJ, the size of the decoder buffer must 
be at least (l+mJ/U-mj) times the size of the encoder 5 
buffer. Therefore, the encoder buffer must be smaller than 
the decoder buffer by the ratio of the maximum rate to the 
minimum rate. If the minimum rate is 2 Mbps and the 
maximum rate is 15 Mbps (maximum rate for MPEG-2 10 
Main Profile Main Level), this implies that the encoder 
buffer should be 1/7.5 times the decoder buffer. Since MPEG 
specifies that the decoder buffer will be 1.8 MB, this would 
make the encoder buffer size only 0.24 MB or 240 KB! 

15 

Since the size of the encoder buffer affects the quality of the 
coded video to a large extent, this is not acceptable. 

Since the range of R(l-mj) to RCH-m^) thus cannot be 
broadened to effectively cover a large piecewise change in 
output rate, another approach is needed. In accordance with 20 
this invention, this is provided by allowing the effective size 
of the encoder buffer to vary! Accordingly, we introduce a 
distinction between the physical and logical sizes of the 
encoder buffer. The physical size of the encoder buffer, 
which will be called B ept is the maximum amount of buffer 25 
memory that has been physically built into the encoder. The 
logical size of the encoder buffer, on the other hand, is the 
part of the physical encoder buffer that the encoder actually 
uses, which is the term called B e heretofore. The difference 30 
now is that B e will be permitted to vary dynamically. In 
accordance with this invention, the encoder can set the 
logical buffer size to be smaller than the physical buffer size 
in order to prevent the decoder buffer from underflowing or 
overflowing, as we will see below. It is the responsibility of 35 
the encoder tp ensure that the encoder logical buffer never 
underflows or overflows. 
. A change in the range of output-rates at which the source 
operates, involves changing R to the new value R B<mrt and 49 
possibly changing mj or or both, without changing the 
delay. Consider the case where R^ is greater than R. The 
maximum value that R,^ can take is determined by the 
physical size of the decoder buffer and from equation 
(EQ13) is given by 



Rmu~ 



45 



(EQ14) 



However, if the encoder wishes to increase the output-rate 
beyond this, and still keep the delay constant, it can still do 50 
so by performing extra buffering at the encoder. This is done 
by ensuring that the encoder buffer never has less than a 
certain minimum number of bits B^. Thus, the new version 
of equation (EQ4) becomes, 55 



(EQ15). 



As a consequence, the modified equation (EQ6) that must ^ 
be satisfied to avoid decoder underflow and overflow is 

(n4A n \ (EQ16) 

Thus, the new version of equation (EQ13) is 65 

RATXUmJZB^B^ (EQ17). 
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The maximum output-rate that can be handled is now 
given by 



(EQ18) 



The portion of the logical encoder buffer which may 
increase and decrease (the effective logical buffer) is now 
B.-B,^. However, if the amount of physical buffer B^ at 
the encoder buffer is not limited, B c can be increased as long 
as equation (EQ1 2) is not violated, thus keeping the effective 
logical buffer size the same as before, and is given by 

B,-Brt»=R±n-m r mJ-M+B d (EQ19). 

The encoder and decoder buffer sizes are given by 

B=RAm-mi}-M (EQ20) 
B^RATM+m^hB^ (EQ21). 
An alternate form of equation (EQ21) is 

B^B r B^RAT{m^m^M (EQ22) 

where: B e -B mtn is the amount of buffer required as a result 
of variable-rate encoding; RATO^+nij) is required as a 
result of varying channel rate; and M is the amount of 
buffering required to accommodate the buffering at the 
remultiplexers. B min is the amount of buffering that needs to 
be done at the encoder in order to maintain the same delay 
at this increased output-rate. Thus, it is possible to operate 
at a higher output-rate and a pre-defined delay by doing at 
the encoder, the extra buffering that is required to keep the 
delay constant. However, note that the logical encoder buffer 
size is still less than that of the decoder buffer. Thus, it is not 
possible to shift any increased buffering caused by variable 
rate operation of the channel, to the encoder. This increased 
buffering which is denoted by RATOn^mJ in equation 
(EQ22) still must be done at the decoder. Operation at the 
new rate can begin only after the encoder is in a position to 
ensure that its buffer will always have B min bits. 

From equation (EQ18), it is easy to see that the delay and 
the maximum allowed value for bit-rate are related. For 
instance, given the size of the decoder and encoder buffers, 
and the fact that they have to hold bits that would be 
transmitted over a period of time equal to the delay, the 
larger the delay, the lower the maximum output-rate. If the 
rate has to be increased beyond a value that can be satisfied 
with the existing delay and decoder and encoder buffer sizes, 
then we would have to decrease the delay. This will result in 
dropped frames at the decoder. 

Another parameter that can be changed is the logical size 
of the encoder buffer which can be set equal to a value given 
by equation (EQ20). This is preferable since it results in an 
increase in the logical size of the buffer. However, now that 
we have started changing the buffer sizes in a dynamic 
fashion, it is important to note that B. and B d are functions 
of time. For instance in equation (EQ16), B e is the size of the 
encoder buffer at time nT, and B d is the size of the decoder 
buffer at time (n+A)T. Operation at the new output-rate 
commences with this new value of the encoder buffer size, 
while ensuring that equation (EQ16) is satisfied at all times. 
Increasing m 2 can be done similarly, while decreasing is 
not a problem. 

Now consider the case where R nrw is less than R. lb 
reduce R to R^, the logical size of the encoder buffer must 
be reduced to R nrw AT(l-mi)-M as can be seen from 
equation (EQ20). This can be done as long as the number of 
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bits in the encoder buffer is less than R^ATO-m^M. If 
this is not so, the encoder- attempts to bring the encoder 
buffer to this state. Once that happens, the logical size of the 
encoder buffer is set to Rn^ATXl-m^M. Now the encoder 
continues to operate at the same delay, while ensuring that 5 
the encoder buffer of this new size neither underflows nor 
overflows. This effectively ensures that the decoder buffer 
also doesn't underflow or overflow. Note that bringing the 
encoder buffer to the desired state is not difficult. Usually, 
the encoder buffer will be in the required state, and the lp 
switch over to the new output-rate can be done at once. If the 
buffer is not in the desired state, it implies that the number 
of bits in the encoder buffer satisfies the following relation- 
ship 

15 

R (MW A7Xl-m 1 )-Mg£Bg/t el( Ani-m,)-M (EQ23). 

The likelihood of this increases when R old and are 
substantially different One way of bringing the encoder 
buffer to the required state is for the encoder to start ^ 
producing bits assuming the new reduced rate. Bits will be 
transmitted from the encoder buffer at the old higher rate 
resulting in the buffer becoming progressively less full. 
When the buffer reaches the desired state, transmission will 
commence at the new rate, and the logical buffer size is also ^ 
reduced to the new value. The multiplexer now has to ensure 
that equation (EQ16) is satisfied for the new value of the 
encoder buffer size. Increasing m x is done similarly, while 
decreasing m t is not a problem. 

This method of handling variable output-rate encoding 3Q 
allows the encoder to use a larger encoder buffer at high rates 
while using a smaller buffer at lower rates, thus allowing for 
good quality video and low delay. This is preferable over 
operating with a fixed small value for the encoder buffer or 
with a high delay. To illustrate the differences possible in the 3J 
size of the encoder buffer, consider an encoder operating at 
a range of rates from 2 Mbps to 15 Mops. If the size of the 
decoder buffer is 1.75 Mbits (MPEG-2 Main Profile Main 
Level), then the size of the encoder buffer in a fixed buffer 
size solution is 0.233 Mbits. The delay is 0.122 seconds. ^ 
Using the variable encoder buffer size approach mentioned 
here and the same delay of 0.122 seconds, the logical size of 
the encoder buffer will still be 0.233 Mbits when we operate 
at 2 Mbps, but at 15 Mbps, the encoder buffer can be the 
entire 1.75 Mbits. If one desires to use the entire decoder 
buffer at all rates, the delay would be 0.918 seconds, B„ M 
will be 11.38 Mbits, and B, will be 13.13 Mbits, when 
operating at 15 Mbps, thus resulting in a large encoder buffer 
primarily for generating delay. Note that the solution pre- 
sented here requires the encoder to operate in a piece-wise 5Q 
constant bit-rate mode. If the channel rate for a particular 
encoder varies between and R,^ with the encoder 
having no say in the matter, the encoder buffer will have to 
be Rmin/RffKw times the decoder buffer size. 

55 

DESCRIPTION OF A PREFERRED 
EMBODIMENT 

FIG. 3 is a block diagram of a video communication 
system in accordance with this invention. The decoder in 60 
this embodiment will accommodate variable-rate com- 
pressed data transmission because the logical encoder buffer 
is kept at a size less than the decoder buffer size. The decoder 
buffer should be at least as large as that given by equation 
(EQ22). If the size of the decoder buffer is constrained to be 65 
a particular size (say because it must meet the MPEG 
standard), the other parameters in equation (EQ22) are 
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selected so that the right side of (EQ22) is no less than the 
left side. 

At the encoder end, the logical size of the encoder buffer 
is controlled by a buffer size controller 50. The logical size 
of the encoder buffer is defined by two terms— B mirt and B,. 
B e is the size of the logical buffer. B mtn defines the minimum 
occupancy status of the logical buffer. In other words, the 
logical encoder buffer will always contain at least B min bits. 
Th& effective size of the logical encoder buffer (i.e., 
B-B min ) is used by the buffer fullness detector 34 to 
determine the fullness value of the encoder buffer which will 
be used by an encoding Rate Controller (or quantizer 
controller) 38 in detenmning a quantization size for the 
quantizer 40. It is important to note that the fullness measure 
that is being computed by detector 34 is not the fullness of 
the physical encoder buffer or even the fullness of the logical 
buffer (unless B min =0) t but rather the fullness of the portion 
of the logical encoder buffer that can be filled and emptied 
(i.e., the portion remaining after B min is taken away). 

Either encoder 48 or the communication system 54 can 
request a transmission rate change for encoder 48. Which- 
ever one desires a change, the other must be notified and 
agree before a change is made. Channel-rate controller 52 is 
the control point for the communication network 54. Con- 
troller 52 manages multiplexer 24, which is the multiplexer 
handling encoder 48. Controller 52 also communicates with 
other control functions in the network, which are represented 
in FIG. 3 by system controller 56. Channel-rate controller 52 
also communicates with the buffer size controller 50 of 
encoder 48. When a transmission rate change is desired by 
either the encoder 48 or channel-rate controller 52, these two 
controllers set up a communications dialog (i.e., handshake) 
and one makes a request of the other to change the trans- 
mission rate. If and when the other agrees, the change is 
made. FIG. 4 is flow diagram of the process which occurs at 
the buffer size controller 50 when a transmission bit-rate 
change is requested by the channel-rate controller 52. In 
genera], the buffer size controller computes new parameters 
B min and B e , but does not agree to the change until it has 
made sure that B min has been satisfied. 

Referring now to FIG. 4, buffer size controller 50 receives 
a request to change the bit-rate to R^ via path 60. In block 
62 a determination is made as to whether or not the proposed 
new bit-rate R^ results in a minimum required decoder 
buffer size (at the current delay AT and the current instan- 
taneous bit-rate upwards variation of mj which is less than 
or equal to the actual decoder buffer size B d . This is the 
constraint imposed by equation (EQ13). If the actual 
decoder buffer size is large enough at the proposed R,,^, the 
minimum occupancy state of the logical encoder buffer is set 
to zero in block 64. If not, B mtn is set to equal the shortfall 
in block 66. In block 68, a new logical buffer size B, is 
determined, which is compared to the physical size B ep of 
the encoder buffer in block 70. 

If the physical size of the encoder buffer is too small to 
implement the new logical buffer size required at the pro- 
posed new bit-rate R^, cither the time delay must be 
reduced (which will cause one or more skip frames to occur 
at the decoder) or else the proposed new bit-rate R^ cannot 
be implemented. It is possible for the buffer size controller 
to inform the channel-rate controller 52 that the proposed 
change in bit-rate is not acceptable or that it will cause 
frames to be skipped. The channel-rate controller 52 typi- 
cally has other alternatives available since it multiplexes 
typically many sources. However, in the event that the 
proposed bit-rate change must be implemented by encoder 
48 (or possibly simply as a design choice), in FIG. 4 it has 
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been assumed that the delay will be reduced if the physical 
encoder buffer is not big enough at R,^ which is done by 
block 72. 

If (or when) the physical buffer size is large enough 
(either initially or after a reduction in the time delay), the 5 
number of bits in the encoder buffer is compared in block 74 
with the new value determined earlier in block 66 and 
with the new logical buffer size B e . If there are not enough 
bits in the encoder buffer to satisfy the new B min constraint, 
or there are too many bits in the encoder buffer to satisfy the 10 
new B, constraint, the number of bits in the encoder buffer 
is caused to be adjusted in block 76 until the number of bits 
in the encoder buffer is within the new constraints. 

This may be accomplished by the buffer size controller by 
changing the logical buffer size supplied to the buffer l5 
fullness detector to the new value in advance of telling the 
channel-rate controller that a new bit-rate is acceptable. If it 
is the B m(n constraint that is not satisfied, the buffer size 
controller might increase the size of the logical buffer to the 
new value immediately and supply this new increased value 
to the fullness detector 34. This causes the fullness detector 
to sense (actually compute) an underfilled buffer condition 
and the quantizer controller 38 adjusts the quantization size 
accordingly to increase the bit-rate coming from the quan- 
tizer 40 into the compressor 44 and in turn into the encoder 
buffer 20. When the B mtn condition is satisfied, block 74 25 
senses this condition and passes control on to block 78. 

On the other hand, if the B e constraint is not met, the 
buffer size controller might decrease the size of the logical 
buffer immediately to the new B« value. The fullness detec- 
tor will sense an overfilled condition and the quantizer 
controller will adjust the quantization size accordingly to 
reduce the bit-rate coming from the quantizer into the 
compressor and in turn into the encoder buffer. When the 
new B tf constraint is satisfied, block 74 senses this condition 
and passes control on to block 78. 

Of course it is possible and probably preferable to not 
abruptly change the bit-rate value to the new value, espe- 
cially when block 76 indicates that the fill condition of the 
encoder buffer is not within the new constraints. An abrupt ^ 
change in bit-rate will abruptly change the quantization size, 
and if the new fill constraints are not met, this change will 
be great (i.e., to the limit of quantization size, either the 
largest possible or the smallest possible) to bring the buffer 
fullness within constraints as soon as possible. It is prefer- 45 
able in most circumstances to have the buffer size controller 
gradually change the value of R to R*^, especially when the 
buffer fill constraints are not met in block 76. 

In block 78 the new values for and B e are imple- 
mented by the buffer size controller 50. As described above, 50 
this might be done gradually if desired. When these new 
values have been implemented (or at some point during a 
gradual change to the new values), the output bit-rate change 
to is approved (block 80) by the buffer size controller 
50. This approval is conveyed to the channel-rate controller 55 
52 and in turn to mux 24, where it is implemented. Of 
course, the change to the new rate by mux 24 theoretically 
could be gradual as well. 

Multiplexer 24 takes data from different sources and 
multiplexes them according to a data scheduling technique 60 
that determines the packet slots that belong to the different 
sources. The data scheduler ensures that the decoder buffer 
does not overflow or underflow for a source i operating at 
rate R, and delay AjT by transmitting over a period of time 
equal to the delay (where this window of time is a moving 65 
window) a number of bits between R^A/TO-nti) and 
RfA/m+mJ. An appropriate value for m x and m 2 is 0.02. 



30 



35 



Although a particular embodiment of the present inven- 
tion has been shown and described, many other embodi- 
ments that incorporate the teachings of this invention may be 
easily constructed by those skilled in this art. Furthermore, 
modifications, improvements and variations upon the 
described embodiment would be readily apparent to those of 
ordinary skill and may be made without departing from the 
spirit and scope of this invention, which is defined by the 
appended claims. 

I claim: 

1. Apparatus for transmitting an input signal to a desti- 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

an encoder buffer having a variable effective size for 
receiving and temporarily storing said successive 
coded digital signals, said encoder buffer having a 
fullness value used by said encoder in determining a 
value for said variable encoding rate of said encoder, 
said fullness value of said encoder buffer being deter- 
mined in reference to said variable effective size of said 
encoder buffer; 

a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
variable bit-rate R and for delivering said successive 
coded digital signals to a destination; and 

a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and converting said successive coded digital signals 
into an output signal corresponding to said input signal 
and having a fixed delay AT relative to said input 
signal; 

said encoder buffer having an effective size that increases 
with R. 

2. Apparatus as defined in claim 1 wherein said encoder 
buffer has a physical size which is equal to or greater than 
said effective size of said encoder buffer. 

3. Apparatus as defined in claim 1 wherein said encoder 
buffer has an effective size on the order of RAT. 

4. Apparatus as defined in claim 1 wherein said encoder 
buffer has an effective size approximately equal to RAT. 

5. Apparatus as defined in claim 1 wherein said decoder 
includes a decoder buffer for receiving said successive 
coded digital signals from said communication system, said 
decoder buffer having a size greater than approximately 
RAT. 

6. Apparatus for transmitting an input signal to a desti- 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

an encoder buffer having a variable effective size for 
receiving and temporarily storing said successive 
coded digital signals; 

a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
variable bit-rate R and for delivering said successive 
coded digital signals to a destination; and 

a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and converting said successive coded digital signals 
into an output signal corresponding to said input signal 
and having a fixed delay AT relative to said input 
signal; 

said encoder buffer having an effective size that increases 
with R and wherein M is a total effective maximum 
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buffering capacity of said communication system, said 
variable bit-rate R is an average bit-rate, said commu- 
nication system operates at an instantaneous bit-rate 
that varies in a range from R(l-mi) to RO+rrij), 
wherein is a factor determined by a minimum 
instantaneous bit-rate and m^ is a factor determined by 
a maximum instantaneous bit-rate, and said encoder 
buffer has an effective size approximately equal to 
RATO-m^M 

7. Apparatus as defined in claim 6 wherein said decoder 
includes a decoder buffer for receiving said successive 
coded digital signals from said communication system, and 
wherein B d is the size of said decoder buffer. 

8. Apparatus as denned in claim 7 wherein said decoder 
buffer has a fixed size determined by a standards committee. 

9. Apparatus as defined in claim 7 wherein said decoder 
buffer has a size greater that approximately RATU+mJ. 

10. Apparatus as defined in claim 7 wherein said encoding 
rate is controlled so as to prevent said effective encoder 
buffer from underflowing or overflowing. 

11. Apparatus as defined in claim 10 wherein B^ is a 
minimum fill state of said effective encoder buffer and said 
encoding rate is controlled so as to keep said effective 
encoder from reaching a fill state less than said minimum fill 
state, 

12. Apparatus as defined in claim 11 wherein said mini- 
mum fill state approximately is an amount by which said 
decoder buffer size is less than RATCl+m^. 

13. Apparatus for transmitting an input signal to a desti- 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

a logical encoder buffer of variable size for receiving and 
temporarily storing said successive coded digital sig- 
nals; 

a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
variable average bit-rate R and for delivering said 
successive coded digital signals to a destination; 
a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and for converting said received successive coded 
digital signals into an output signal corresponding to 
said input signal and having a fixed delay AT relative 
to said input signal; 
said encoder including: 
an encoder buffer fullness detector for determining a 

current fullness state for said logical encoder buffer, 
an encoding rate controller responsive to said current 

fullness state for varying said encoding rate so as to 

keep said logical encoder buffer from overflowing or 

underflowing; and 
a logical encoder buffer size controller for increasing 

said size of said logical encoder buffer with R. 

14. Apparatus as defined in claim 13 wherein said logical 
encoder buffer size controller maintains said logical encoder 
buffer at a size on the order of RAT. 

15. Apparatus as defined in claim 13 wherein said logical 
encoder buffer size controller maintains said logical encoder 
buffer at a size approximately equal to RAT. 

16. Apparatus for transmitting an input signal to a desti- 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

a logical encoder buffer of variable size for receiving and 65 
temporarily storing said successive coded digital sig- 
nals; 
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a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
variable average bit-rate R and for delivering said 
successive coded digital signals to a destination; 
a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and for converting said received successive coded 
digital signals into an output signal corresponding to 
said input signal and having a fixed delay AT relative 
to said input signal; 
said encoder buffer including: 
an encoder buffer fullness detector for determining a 
current fullness state for said logical encoder buffer 
an encoding rate controller responsive to said current 
fullness state for varying said encoding rate so as to 
keep said logical encoder buffer from overflowing or 
underflowing; and 
a logical encoder buffer size controller for increasing 
said size of said logical encoder buffer with R and 
wherein M is a total effective maximum buffering 
capacity of said communication system, said com- 
munication system receives said successive coded 
digital signals at an instantaneous bit-rate that varies 
in a range from R^-n^) to RO+mJ, wherein m l is 
a factor determined by a minimum instantaneous 
bit-rate and m 2 is a factor determined by a maximum 
instantaneous bit-rate, and said logical encoder 
buffer size controller maintains said logical encoder 
buffer at a size approximately equal to RATCl-mj)- 
M. 

17. Apparatus as defined in claim 16 wherein said encod- 
ing rate controller varies said encoding rate so as to keep 
said logical encoder buffer from reaching a fullness state 
corresponding to a fill of less than a minimum number of 
bits, wherein is said minimum number of bits. 

18. Apparatus as defined in claim 17 wherein said encod- 
ing buffer fullness detector determines a current fullness 
state above B mfn . 

19. Apparatus as defined in claim 17 wherein said decoder 
includes a decoder buffer, B rf is the size of said decoder 
buffer, and B min is approximately an amount by which E d is 
less than RAT(l+mJ. 

20. Apparatus for transmitting an input signal to a desti- 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

a logical encoder buffer of variable size for receiving and 
temporarily storing said successive coded digital sig- 
nals; 

a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
variable average bit-rate R and for delivering said 
successive coded digital signals to a destination; and 

a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and for converting said successive coded digital signal 
into an output signal corresponding to said input signal 
and having a fixed delay AT relative to said input 
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said encoder including: 
a quantizer for converting said input signal into suc- 
cessive quantized digital signals at a variable quan- 
tization size; 

a compressor for converting said quantized digital 
signals into successive coded digital signals; 

an encoder buffer fullness detector for determining a 
current fullness state for said logical encoder buffer, 



11/21/2003, EAST Version: 1.4.1 



5,566,208 



17 

a quantization size controller responsive to said current 
fullness state for varying said quantization size so as 
to keep said logical encoder buffer from overflowing 
or underflowing; and 

a logical buffer size controller for increasing said size 5 
of said logical encoder buffer with R. 

21. Apparatus as defined in claim 20 wherein said logical 
buffer size controller maintains said logical encoder buffer at 
a size approximately equal to RAT. 

22. Apparatus for transmitting an input signal to a desti- to 
nation, comprising: 

an encoder for converting said input signal into successive 
coded digital signals at a variable encoding rate; 

a logical encoder buffer of variable size for receiving and 
temporarily storing said successive coded digital sig- 15 
rials; 

a communication system for receiving said successive 
coded digital signals from said encoder buffer at a 
'variable average bit-rate R and for delivering said ^ 
successive coded digital signals to a destination; and 

a decoder at said destination for receiving said successive 
coded digital signals from said communication system 
and for converting said successive coded digital signals 
into an output signal corresponding to said input signal 25 
and having a fixed delay AT relative to said input 
signal; 

said encoder including: 
a quantizer for converting said input signal into suc- 
cessive quantized digital signals at a variable quan- 30 
tization size; 

a compressor for converting said quantized digital 
signals into successive coded digital signals; 



an encoder buffer fullness detector for determining a 
current fullness state for said logical encoder buffer; 

a quantization size controller responsive to said current 
fullness state for varying said quantization size so as 
to keep said logical encoder buffer from overflowing 
or underflowing; and 

a logical buffer size controller for increasing said size 
of said logical encoder buffer with R and wherein M 
is a total effective maximum buffering capacity of 
said communication system, said communication 
system receives said successive coded digital signals 
at an instantaneous bit-rate that varies in a range 
from RCl-mj) to R(l+mj), wherein m 2 is a factor 
determined by a minimum instantaneous bit-rate and 
nvj is a factor determined by a maximum instanta- 
neous bit-rate, and said logical encoder buffer size 
controller maintains said logical encoder buffer at a 
size approximately equal to RATCl-m^M. 

23. Apparatus as defined in claim 22 wherein m l and m 2 
are on the order of 0.02. 

24. Apparatus as defined in claim 22 wherein said com- 
munication system includes a channel-rate controller for 
determining an average bit-rate R at which said communi- 
cation system receives said successive coded digital signals, 
said channel-rate controller and said logical encoder buffer 
size controller communicating to each other prospective 
changes in R. 

25. Apparatus as defined in claim 24 wherein said logical 
encoder buffer size controller effectively changes said size 
of said logical encoder buffer in advance of changes in R in 
order to obtain an encoder buffer fullness state within limits 
when R changes. 
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